Using HPC infrastructures for deep learning applications in fusion research
نویسندگان
چکیده
In the fusion community, use of high performance computing (HPC) has been mostly dominated by heavy-duty plasma simulations, such as those based on particle-in-cell and gyrokinetic codes. However, there a growing interest in applying machine learning for knowledge discovery top large amounts experimental data collected from devices. particular, deep models are especially hungry accelerated hardware, graphics processing units (GPUs), it is becoming more common to find competing same resources that used simulation codes, which can be either CPU- or GPU-bound. this paper, we give examples models—such convolutional neural networks, recurrent variational autoencoders—hat variety tasks, including image processing, disruption prediction, anomaly detection diagnostics data. context, discuss how go using single GPU node multiple GPUs across nodes large-scale HPC infrastructure.
منابع مشابه
Diagnosing Performance Variations in HPC Applications Using Machine Learning
With the growing complexity and scale of high performance computing (HPC) systems, application performance variation has become a significant challenge in efficient and resilient system management. Application performance variation can be caused by resource contention as well as softwareand firmware-related problems, and can lead to premature job termination, reduced performance, and wasted com...
متن کاملDeep learning with COTS HPC systems
Scaling up deep learning algorithms has been shown to lead to increased performance in benchmark tasks and to enable discovery of complex high-level features. Recent efforts to train extremely large networks (with over 1 billion parameters) have relied on cloudlike computing infrastructure and thousands of CPU cores. In this paper, we present technical details and results from our own system ba...
متن کاملOn Scale-out Deep Learning Training for Cloud and HPC
Srinivas Sridharan, Karthikeyan Vaidyanathan, Dhiraj Kalamkar, Dipankar Das, Mikhail E. Smorkalov, Mikhail Shiryaev, Dheevatsa Mudigere, Naveen Mellempudi, Sasikanth Avancha, Bharat Kaul, Pradeep Dubey Intel Corporation [srinivas.sridharan,karthikeyan.vaidyanathan,dhiraj.kalamkar,dipankar.das,mikhail.e.smorkalov,mikhail.shiryaev, dheevatsa.mudigere,naveen.mellempudi,sasikanth.avancha,bharat.kau...
متن کاملPilot-Abstraction: A Valid Abstraction for Data-Intensive Applications on HPC, Hadoop and Cloud Infrastructures?
HPC environments have traditionally been designed to meet the compute demand of scientific applications and data has only been a second order concern. With science moving toward data-driven discoveries relying more and more on correlations in data to form scientific hypotheses, the limitations of existing HPC approaches become apparent: Architectural paradigms such as the separation of storage ...
متن کاملNamed Entity Recognition in Persian Text using Deep Learning
Named entities recognition is a fundamental task in the field of natural language processing. It is also known as a subset of information extraction. The process of recognizing named entities aims at finding proper nouns in the text and classifying them into predetermined classes such as names of people, organizations, and places. In this paper, we propose a named entity recognizer which benefi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Plasma Physics and Controlled Fusion
سال: 2021
ISSN: ['1361-6587', '0741-3335']
DOI: https://doi.org/10.1088/1361-6587/ac0a3b